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Abstract. We improve, first, a strong invariance principle from [5] for non- 
conventional sums of the form Y^n=\ F ( X ( n )> X ( 2n ), -,X{in)) (normalized 
by 1/VN) where X(n), n > O's is a sufficiently fast mixing vector process with 
some moment conditions and stationarity properties and F satisfies some reg- 
ularity conditions. Applying this result we obtain next a version of the law of 
iterated logarithm for such sums, as well as an almost sure central limit the- 
orem. Among motivations for such results are their applications to multiple 
recurrence for stochastic processes and dynamical systems. 



1. Introduction 

In this paper we study almost sure limit theorems for nonconventional sums of 
the form 

(1.1) B(t)= £ (F( x (n),X(2n),...,X(£n))-F) 

l<n<* 

where X{n),n > O's is a sufficiently fast mixing vector valued process with some 
moment conditions and stationarity properties, F is a continuous function with 
polinomial growth and certain regularity properties, F — J Fd(fi x • • • x fx) and 
\x is the distribution of -^(0). The name "nonconventional" comes from 4 where 
ergodic theorems for averages N~ 1 E(N) were studied in the case when X(n) = 
X(n,x) — T n x with T being a measure preserving ergodic transformation. We 
observe that the topic of nonconvenional ergodic theorems was extensively studied 
during the last 30 years. 

Recently the setup of nonconventional sums was studied from the probabilistic 
point of view and the strong law of large numbers, the functional central limit 
theorem and a version of the strong invariance principle (called also a strong ap- 
proximation theorem) were obtained in [8] , |10j and [9] , respectively. In this paper 
we partially improve the strong invariance principle from [5] which enable us both 
to obtain a better than in [9] version of the law of iterated logarithm and, moreover, 
to derive an almost sure central limit theorem for sums S(i). We will show in this 



Date: September 11, 2012. 

2000 Mathematics Subject Classification. Primary: 60F15 Secondary: 60G15, 60G42, 37D20, 
60F17. 

Key words and phrases, strong approximations, almost sure central limit theorem, martingale 
approximation, mixing, dynamical systems. 



1 



2 



Yu.Kifor 



paper that the sum S(i) can be approximated as t — > oo with an error term of 
order i 5_7 , 7 > by certain Gaussian process G(t) having, in general, dependent 
increments. This will enable us to obtain the law of iterated logarithm and the 
almost sure central limit by certain modifications of familiar proofs. We observe 
that in [Hj strong approximations were obtained only for certain components of the 
sum £(t) which did not allow to derive the corresponding result for the whole sum. 
On the other hand, terms X(q(nj) with nonlinear q(n) were considered in [S] while 
we do not deal with them here. 

One of motivations for nonconventional limit theorems comes from multiple re- 
currence problems. Let, for instance, F{x\, .-.,xi) — x\ ■ • • xi and X(n) — Ia^u) 
where 1^ is the indicator of a set A and is either a dynamical system = 
£ n (w) = T n oo or a Markov chain. Then E(N) = Y£=i F ( X ( n )> •••> X{ln)) is the 
number of events {£„ £ A, £ 2 n € A, ...,£t n £ A} for n < N, and so our results de- 
scribe limiting behavior of such quantities. This also can be described as a number 
of arithmetic progressions of length £ starting at whose difference is between 1 
and N and such that at any positive time belonging to such progression the process 
£ is contained in A. 

As in jS], [9] and [10] our results hold true when, for instance, X(n) = T n f 
where / = f p ), T is a mixing subshift of finite type, a hyperbolic diffeo- 

morphism (see [T]) or an expanding transformation taken with a Gibbs invariant 
measure, as well, as in the case when X(n) = / = (/1, fp) where is a 

Markov chain satisfying the Doeblin condition (see, for instance, [7]) considered as 
a stationary process with respect to its invariant measure. Furthermore, our results 
are applicable to other dynamical systems such as the Gauss map of the interval 
(see, for instance, [7] or [B]) and a large class of transformations having a spectral 
gap of their transfer operator which ensure their fast mixing properties. On the 
probabilistic side our results work for Markov processes having transition operators 
with a spectral gap, in particular, for Ornstein-Uhlenbeck type processes. 

2. Preliminaries and main results 

As in [9] we deal with the setup which consists of a p-dimensional stochastic 
process {X(n),n = 0,1,...} on a probability space (£l,F,P) and of a family of 
er-algebras Fm C J 7 , —00 < k < I < 00 such that Th C Tyv i£ k' < k and V > I. 
The dependence between two sub cr-algebras Q^H C J- is measured often via the 
quantities 

(2.1) tu q}P (Q,'H) = sup{\\ E[g\Q] - E[g]\\ p : g is % — measurable and \\g\\ q < 1}, 

where the supremum is taken over real functions and || • || r is the L r (Q, J 7 , P)-norm. 
Then more familiar a, p, 4> and •i/'-mixing (dependence) coefficients can be expressed 
in the form (see [2], Ch. 4 ), 

<f>(G,H) = ^oo : oo(G,H) and ip{G,H) = ^i,oo(G,H). 
The relevant quantities in our setup are 

(2.2) W qt p(n) — SVipZD q , p ('F-oo,k, -Pfc+n.oc) 

fc>0 
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and accordingly 

a(n) = ^a7oo,i( n )i P( n ) = ro 2,2(n), (j>{n) = ^^^(n) and ip{n) = w\ t00 {n). 

Our assumptions will require certain speed of decay as n — > oo of both the mixing 
rates w qjP (n) and the approximation rates defined by 

(2.3) P p (n) = sup \\X(m) - E(X(m)\T m - n , m+n )\\ p . 

m>0 

In what follows we can always extend the definitions of Tu given only for k, I > 
to negative k by defining Tw = Toi for k < and I > 0. Furthermore, we do not 
require stationarity of the process X(n),n > assuming only that the distribution 
of X(n) does not depend on n and the joint distribution of {X(n), X(n')} depends 
only on n — n' which we write for further references by 

(2.4) X(n) ~ n and (X(n),X(n')) ~ //„_„/ for all n, rc' 
where Y ^ Z means that Y and Z have the same distribution. 



Next, let F — F(x±, ...,xi), Xj € R p be a function on M. pt such that for some 
l,K > 0, k e (0, 1] and all z;,^ e K p ,z = 1, ...,£, 

e e e 

(2.5) IF^, ...,x e ) - F( yi , ...,y t )\ < # (l + E + E IfilO E \ x i " 

j'=i i =1 j =1 

and 

(2.6) |F(z 1) .., iB/ )|<tf(l + EN 1 )- 

3=1 

The above assumptions allow us to consider, for instance, functions F polynomially 
dependent on their arguments, in particular, the product function F(x\, ...,xg) = 
Xi,...,xg. To simplify formulas we assume a centering condition 

(2.7) F = J F(x 1 ,...,xe)d/j,{x 1 )---d f i(x e ) = 

which is not really a restriction since we always can replace F by F — F. 
For each 6 > set 

7e e = ||X||« = £|X(n)| e = J 11*11%. 
Our main result relies on 

2.1. Assumption. With d ~ (£ — l)p there exist p, g > 1 and <5, m > with 
5 < k — | satisfying 



nm q:P (n) < oo, 

n=0 

oo 



r=0 



. , 1 1 i + 2 5 

7m < OO ,72 9(t+ 2) < OO With — > - + — - + - . 
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A reader willing to avoid some visual technicalities may be advised to consider 
bounded Lipschitz continuous functions F and exponentially fast decaying zu q , p (n) 
/3 q (n) as n — > oo but since we mostly rely in this paper on estimates from |10) and 
[9] this would not matter much here. 

As in [10] a crucial part of our approach is the representation of F — F(x\, x£) 
in the form 

(2.8) F = F 1 {x 1 ) + ■■■+ Fi{x u x 2 , ...,xt) 

where for i < £, 

Fi(xi,...,Xi) = J F(x!,X2,...,Xi) dfx(x i+ x) ■ ■ ■ d(j,(xi) 
- J F(x 1 ,x 2 , -..,xi) dfi(xi) ■ ■ ■ dfi(x e ) 

and 

F e (x 1 ,x 2 , ■ . ■ ,x e ) = F(xi,x 2 ,...,xe) - J F(x 1: x 2 , ■ ■ ■ , xg) d^{x t ) 
which ensures, in particular, that 

(2.9) J F l (x 1 ,x 2 , . . . , Xi-i,xi) d(i(xi) = V xi,x 2 , ...,Xi-\. 
These enable us to write 

l 

(2.10) S(t) 



i=l 



where for 1 < i < t. 



(2.11) *<(<)= J2 Fi(X(n),X{2n),...,X{in)). 

\<n<t/i 

As in [15] we will write Z(t) -C a(t) a.s. for a family of random variables 
Z(t),t > and a positive function a(t),t > if lim sup t _ voo \Z{t)/a{t)\ < oo almost 
surely (a.s.) 



2.2. Theorem. Suppose that Assumption \2.1\ holds true. Then without chang- 
ing its distribution the process H(t), t > given by can be redefined on 
a richer probability space where there exists an I- dimensional Gaussian process 
G{t) = (Gi(t), Gi(t)) with stationary independent increments having covariances 
EGi(s)Gj(t) — DijsAt, for some nonnegatively definite matrix D = (Dy , 1 < i,j < 
£) and such that for some constant 7 > 0, 



(2.12) 5(t)-Q(t)«t* 



-7 



where Q(t) = Yjj=i Gj(jt) is a Gaussian process having, in general, dependent 
increments (see [10] J. 

As in [5] we will rely on the representation (|2.10l) but in [5] we were able to obtain 
strong invariance principles only for each ^ separately while Theorem 12 .21 provides 
a strong invariance principle for the original process S. The proof of Theorem 12.21 
will rely on strong approximation of the vector process ^(t) = (*f?i(t), ^e(t)) by 
the vector Gaussian process G(t) which unlike 9 cannot be done via the Skorokhod 
embedding and we will have to verify conditions of another approach from [16j (see 
also [TS] and references there). 
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Let 

(2.13) R(s,t) = EQ(s)Q(t) = £ D tj ((ia) A (jt)) 

l<i,j<l 

be the covariance function of the Gaussian process Q(t), t > 0. Observe that 
R(rs,rt) = rR(s,t) for any r > 0. This together with (|2.12|) and (|2.13|) enable us 
to rely on the law of iterated logarithm for Gaussian processes from [14) which is 
formulated in terms of the reproducing kernel Hilbert space H corresponding to 
the kernel R(s,t). Namely, we obtain 

2.3. Corollary. Let K = {h G H : \\h\\ H R(l, 1) < 1} where \\ ■ \\ H denotes the 
norm in H . Then the sequence of random functions 

(2.14) f n (t) = E(nt)(2R(n,n)\n\nn)- 1/2 , n > 3 

is a.s. equicontinuous and its set of limit points is a.s. contained in K. 

In order to conclude that the set of limit points of the sequence f n coincides with 
K we have to impose at least some nondegeneracy conditions on the pair of F and 
the process X(n), n > but this question is not quite clear yet. It seems natural 
to expect that for generic (in some sense) pairs of F and X(n), n > the set of 
limit points of the sequence f n will coincide with K. 

Next, we describe our results concerning an a.s. central limit theorem. For each 
t G [0, 1] and n G N set 

(2.15) Q n (t) = n- 1/2 E([nt])(l + [nt] - nt) + n" 1/2 S([nt] + i)(nt - [nt]) 

which produces a random element of the space C[0, 1] of continuous functions on 
[0, 1] considered with the supremum norm topology. Denote also by rjQ the prob- 
ability distribution of the process Q(t), t £ [0, 1] on C[0, 1] while, as usual, by 5 X 
with x € C[0, 1] we denote the unit mass at x. 

2.4. Theorem. Under Assumption 2.1 and notations above 



n 

(2.16) lim —Y,k-H Qh 



n^co [nn ' 

k=l 

where the limit is taken in the sense of weak convergence of measures on C[0, 1]. 
This result can be rephrased saying that outside of a single probability zero set 

1 " 

(2.17) lim- J! fc" 1 ^) =<f>{riQ) a.s. 

k=l 

for all measurable functions 4> on C[0, 1] which are continuous t)q— a.s., where <P(t]q) 
is the image measure of rjQ under (f>. Letting, in particular, <fii(x) = x(l) we obtain 
that a.s. as n — > oo, 

1 n 

(2.18) lim k~ 1 S^ (k \ k -i/2 — distribution of Q(l). 

n— >oo [nn ^ — ' 

fe=l 

Our proof of Theorem l2.4l will follow the scheme of |3] (see also [11]) deriving first 
an almost sure central limit theorem for the Gaussian process Q from Theorem 12. 21 
and then relying on the strong approximation result (|2.12[) in place of the Skorokhod 
embedding (representation) employed in [3 which does not work here. 
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2.5. Remark. An analogy of Corollary 1.5 from [3] concerning the arcsine distri- 
bution can also be obtained in our circumstances. Namely, let 

L n = n -1 #{A: : 3(Jfe) > 0, 1 < k < n} 

and define <p : C[0, 1] — > M by <p{x) =Lebesgue measure of {u 6 [0, 1] : x{u) > 0}. 
It is easy to see that <f> is TyQ-a.s. continuous and it follows from Theorem 12 .41 that 
with probability one 

1 - 

(2.19) lim — E fc "%(Q,)=^%) 

fc=i 

where the right hand side of (|2.19l) can be interpreted as an analogy of the arcsine 
law corresponding to the Gaussian process Q in the same sense as the usual arcsine 
law corresponds to the standard Brownian motion. Now, with probability one 

lim \4>{Q n )-L n \=0 

n— f oo 

and employing an analogy of Lemma 2.12 from [3] (see Lemma l'Ol below) we obtain 
that with probability one 

1 - 

(2.20) Urn — XV 1 *^ = Mq). 

n->oo inn ^ — ' 

k=l 

2.6. Remark. In addition to almost sure central limit theorem large deviations 
from the limit were studied, as well (see [T3] and [5])- These results were also based 
on strong approximations but it was crucial there to rely for that on the Skorokhod 
embedding into the Brownian motion where rather specific estimates are available. 
Namely, for these large deviations estimates the result of Theorem 12.21 in the form 
(|2.12[) does not suffice since now we have to show that for each e > 0, 

(2.21) lim 7^-lnP{ sup \S(s) - Q(s)\ > eVi} = -oo. 
t^oolnt o<s<t 

We can do this for each ^(s) — Gi(s)\ separately obtaining Gi via the Skorokhod 
embedding as in [5| but for S we need a multidimensional version of strong approx- 
imations for which estimates of the form (|2.21[) do not seem to be directly available 
though they should be possible under appropriate conditions. For instance, (|2.21[) 
would hold true if for any m G N, t > and some C, e > 0, 

(2.22) E sup \E{s) - Q(s)\ m < Ct m ^- e l 

0<s<t 

The latter inequality can be obtained via estimates of the form 

P{\A n -B n \ >a n } <a n , 

where A n = ^i(n) — ^(n— 1) and B n = Gj(n) — Gj(n — 1), which appear in proofs 
of usual multidimensional strong approximation theorems (cf., for instance, Section 
2.4 in [H]). 

3. Strong approximations 

The following result which is a part of Corollary 3.6 from [10] will be a basis of 
estimates here. 
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3.1. Proposition. Let Q and % be a-subalgebras on a probability space (f2, J 7 , P), 
X and Y be d- dimensional random vectors and f = f(x, w) be collections of random 
variables that are continuously (or separable) dependent on x € M. d for almost all 
U), measurable with respect to % and satisfy 

\\f{x,uj) - f(y,v)\\ q < 0,(1 + \x\> + |y|')|a: - y\« 
and\\f{x,uj)\\ q <C 2 {l + \xY). 

Setf(x,u)=E(f(x,-)\g)(u) andg(x)=Ef(x,u). 

(i) Assume that q> p, 1 > k> 9 > ± and i > ± + i±2 + A . Then 

\ / i — f j — p a — p ' m q 

(3.1) \\E{f(X, -)\Q) - g{X)\\ a < c(l + \\X\V+*){w q>p {Q ,U) + \\X - E(X\g)\\ s q ) 

where c — c(l, k, 9,p, q, a, 5, d) > depends only on the parameters in brackets. 

(ii) Furthermore, let x = (v,z) and X = (II, Y), where II and T are d\ and 
d — d\- dimensional random vectors, respectively, and let f(x,uj) = f(v,z,u>) satisfy 
the conditions above in x = (v,z). Set g(v) = E[f(v,T(ui),ui)]. Then 

(3.2) \\E(f(U, T, - g(U)\\a < c (1 + \\X\\^) 

x (™ q , p (g,H) + ||n - E(n\g)\\ s q + \\r- E(r\n t )\\ s q ). 

(Hi) Furthermore, for a,p,q,L,m,S satisfying conditions of (i), 

(3-3) \\f(X(uj),uj) - f(Y(u),u) - g(X) + g(Y)\\ a 

< cw qtP (g,H)(l + \\X\\^ + \\Y\\£ 2 )\\X - Y\\ q 

where c — c(i, K, 9,p, q, a, S, d) > depends only on the parameters in brackets. 

Observe that the conditions of Proposition ^ . 1 1 are satisfied in all our applications 
below in view of (I2.5[) and (|2.6p . We will rely on the following result which in a 
close form appears as Theorem 1.3 in [TB] (see also [T5] and references there). 

3.2. Theorem. Let {M(n), G n }n=i> M ( n ) = ( M i{n), M e (n)) be a square- 
integrable sequence of Mf -valued martingale differences on a probability space 
(£l,g,P). Define conditional covariance matrices o~(n) = o~ij(n))i<ij<e by 

a^n) = ^(M^rOM^nJISn-i) 

and set S(n) = Y^—y o~{k). Suppose that there exists a covariance matrix D and a 
constant 7 <E (0,1) such that 

(3.4) £(n) - nD < n 1 ^ a.s. or E\\T±(n) - nD\\ = C^n 1-7 ), 

where \\ ■ \\ is the Euclidean matrix norm, and 

00 

(3.5) " 7 " 1S (ll M (")H 2l l|M(n)||»>»i-r) < OO. 
n=l 

Then without changing its distribution the sequence {M(n), n > 1} can be redefined 
on a richer probability space where there exists a sequence {Y(n), n > 1} of inde- 
pendent identically distributed (i.i.d.) random vectors with the covariance matrix 
D and an l-dimensional Brownian motion Z(t), t > with the covariance matrix 
D such that 

(3.6) ^](Af(fc) - r(fc)) < and 
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(3.7) ^M(fc)-Z(t)<^-« 

k<t 

where k > does not depend on n or on t. 

Actually, only (13.61) is obtained in [TB] but, in fact, Q3.7[) follows from p.6[) by 
a standard argument based on the Kolmogorov extension theorem (see Section 
2.4 in [12 ]). We observe also that if the original probability space (fi, J 7 , P) is 
already rich enough to have a uniformly distributed random variable independent 
of the sequence {M(n), n > 1} then the sequence {Y(n), n > 1} and the process 
{Z(t), t > 0} can already be constructed on (fi,.F, P) and there is no need in 
enrichment and in redefinitions. 

Our Theorem 12 . 2 1 will follow immediately from the following result. 

3.3. Proposition. Suppose that Assumption \2.1\ holds true. Then without chang- 
ing its distributions the vector process 4 r (f) = (f&i(t), ^(t)), t > (with "J^ i/ie 
same as in i2.9\) ) can be redefined on a richer probability space where there exists an 
I- dimensional Gaussian process G(t) = (Gi(t), Ge(t)) with stationary indepen- 
dent increments having covariances EGi{s)Gj{t) = fly-sAt for some nonnegatively 
definite matrix A = (ay, 1 < i,j < and swc/i £/iat /or some constant 7 > 0, 

(3.8) - G(t) « ti-T a.s. 

Proof. First, we recall the block construction from [9]. We will use the following 
notations from [9] 

(3.9) Fi : r, n {xi,x 2l ■ ■ .,Xi-i,w) = E(F(xi,x 2 , ■ ■ . ,a; l _i,X(n))|J r „_ ri „ +r ), 
X r (n) =E(X{n)\F n - r , n+r ), Y^n)) = F i (X(q 1 (n)),...,X(q i (n))) and 

Yi(j) = if j^qi(n) for any n, Y it7 .(qi(n)) = F i ^ qiM (X r (q 1 (n)), 
...,X r (qi-x(n)),u]) and Y iir (j) = i/ j Qi{ n ) for any n. 

Next, we fix some positive numbers Arj < 29 < t < <5/4 where <5 is the same as in 
Assumption 12.11 Now, we introduce pairs of "big" and "small" increasing blocks 
(somewhat differently than in [9]) defining for each i random variables Vi(j) and 
Wi(j) inductively so that 

(3.10) ^(1) = ^,ife(l)), Wi(l) = Y A (q % (2)), a(l) = 0, 6(1) - 1 and for j > 1, 

a(j) = b(j - 1) + [(j - 1)% b(j) = a(j) + m r(j) = [j% 

= EaU)<U<bU) Y i,r(j)( il ) and W <(J) = Efe(j)<«<«(i+1) F ^0)(*0- 

Next, set 

00 

(3.11) Ri(m) = E (Vi(j)\g m ) 

j=m+l 

and Mi(m) — Vi(m) + Ri(m) — Ri(m— 1) where Q m = J 7 - 00, b(m)+r(m)- In the same 
way as in Section 3 of [9] we see that (Mj(m), G m )m>i is a martingale differences 
sequence for each i = 1, ...,£, and so M{m) = (Mi(m), M^(m)), m > 1 is a 
vector martingale differences sequence. Now, proceeding similarly to Section 3 in 
[5] we obtain that for some e > 0, 

(3.12) ||*(t)- 2 M(j)||«t*- e a.s 

l<3'<f(*) 
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where v{t) — max{j : b(j) + [j ] < t} and || • || is the Euclidean norm in R . 

In order to complete the proof of Proposition 13.31 it remains to veryfy 
the conditions of Theorem 13.21 for the vector martingale differences sequence 
(M(m), Q m )m>i- In Section 4 of [9] we showed relying on Proposition 13.11 that 
for each i = 1, ...,£, 

(3.13) E^j{t)- M t 2 (0<i 1_£ a.s 

l<l<v(t) 

for some e > independent of t. Essentially, the same proof shows that for any 
i,j = !,-,£, 

(3.14) E^i{t)^j(t) - Mi(/)M,-(0 < i 1-e a.s 

l<l<v(t) 

for some e > independent of t. Existence and a description of the limit 

(3.15) lim r l E^i(t)^At) = D i:j 

t—^OO 

was provided by Proposition 4.1 from |10j . In fact, it turns out that 

(3.16) Dijt\ <C 

for some Co > independent of t which is actually hidden inside of the proof 
in [10], though, of course, a bound Coi 1_e , e > in the right hand side of (|3.16p 
would suffice for our purposes, as well. The corresponding arguments are essentially 
contained at the end of Section 4 in [9] but for readers' convenience we explain them 
here too. 

Recall, that according to Proposition 4.1 of [TU] (see also Lemma 4.4 there) the 
limit in (|3.15l) can be written in the form 

oo 

(3.17) Dij = — ^2 aij(u,2u,...,vu) 

t> i 

U — — OQ 

where v is the greatest common divisor of i and j with i — vi' , j — vj' and 
being coprime and 

(3.18) Oij(u,2u, ...,vu) = j F i {x 1 ,...,x l )F j {y 1 ,... 1 y j ) 

where dfio(x,y) — S x , y d^,(x) is the measure supported by the diagonal. 
Next, we have 

(3.19) E* i (t)V j (t)= J2 bij(n,n') 

0<n<t/i, 0<n'<t/j 

where 

b^n 1 ) ^ EF l {X{n),...,X{in))F ] {X{n'),...,X{ ] n 1 )). 

Suppose that \in — jn'\ = m < ^ max(fi, n') and let, for instance, in ~ jn' = m. 
Then in > n' > (n — m)/£, and so max(n, n') < In and m < n/4. It follows that 

min(m, jn') — max((i — l)n, (j — l)n') = min(n — m, n') 

>(n-m)/<>>%> 3ma $> n '\ 
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The same argument works for the case jn' — in = m, as well. Hence we can apply 
Proposition 13 . 1 f ii) with 

^ oo,min(m,jn' )— max(n.n') 3 ^ "^'mmfin.jn')-^ max(n,n')' 

n = (X(n), X((i - l)n);X(n'), X((j - l)n'))) and T = (X(in), X{jn')) 
which yields that 

(3.20) ^(n.n')-/ lln),^^'),.., 

- l)?i'),2/)dMO,J/)| < Ci(tJ7,,p(^!r max(n,n')) + p 5 q {jp max(n,n'))) 

for some Ci > independent of n and n'. 

We proceed by induction dealing with the case \in — jn'\ — m > -j max(n, n') 
by the argument below. Suppose that we already proved that for some k < i and 
k'<j, 

(3.21) Ibiji^n')- J EF i {X{n),...,X{kn),x k+1 ,...,x i )F j {X{n'),..., 
X(k'n'),y k - +1 , y J )dv(x k+1 , x h y k '+i, ■-, yj)\ < e k:k > (n, n'). 

If \kn — k'n'\ < max(n, n') then in the same way as in (|3.20[) we obtain that 

(3.22) |6y(n, n') - J EFi{X{n), X{{k - l)n), x k , Xi )F 3 (X(n'), 
X((k' - l)n'),y k ,, yj)dn kn -k>n>(xk, y k >)v{x k+1 , x h y k >+i, —,Vj)\ 

< £ ktk '(n,n') +C 2 (n7 giP ( 3 i T max(n,n')) + P 5 q {jp max(ra, n'))) 

for some Ci > independent of n and n' . On the other hand, if \kn — k'n'\ > 
max(ra, n') then 

max(fcn, k'n) > max ( min(/cn, k'n), max((/c — l)n, (k' — 1)«')) + max ( n i 
and so we can apply again Proposition 13. lf ii) with 

^ oo,max(fcn,fc'n') 777 max(n.ii') ' ^ '^'maxffen./j'Ti') ^maxfTi.nMj 

n = (X(n), X((k - l)n); X(n'), - l)n'); X(min(fcn, fc'n'))) 
and T = X(max(kn, k'n')) to obtain that 

(3.23) |6tf (n, n') - J EF t {X{n), X((k - l)n), C4„, x fe+1 , x,)^ (X(n'), 
X((fc' - l)n'), U k > n >,y k > +1 , yj)d{i(U max ( kritk ' n >))v(x k+ i , Xi,y k > +1 , yj)\ 

< e ktk >(n,n') + C 3 (m q>p (j^p max(n, n')) + fi s q {j^p max(n, n'))) 

for some C3 > independent of n and n' where U m - ln ^ kn ^ k > n >^ = X(min(fcn, k'n')). 
In particular, if k = i and k' = j we obtain from (|2.9j) that 

(3.24) Mn,n')| < CaK,^ max(n,n')) + #(^ max(n,n'))). 

This together with the above induction argument yields that 
(3.25) 

1 1 

\bij(n,n ) - a tJ (u, 2u, ...,vu)\ < Ci{w qtJ) {^p max(n, n )) + /3 ? (y^ max(n, n'))) 

for some C4 > independent of n and n' provided ni — jn' = vu and i> is the 
greatest common divisor of i and j with fly defined by (|3.18[) . 

It is not difficult to see (the explanation can be found in the proof of Lemma 
4.4 of [10]) that the number of integer solutions of in — jn' — vu with in, jn' < t 
can differ from [vt(ij)~ l ] by at most a constant independent of t. This together 
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with (|3TF]H[339]l . (|3^5]1 and Assumption O yields ([3J6]) . Taking into account 
(|3.14[) we conclude that the condition (|3.4j) of Theorem [321 is satisfied for the vector 
martingale differences sequence {M{j), 1 < j < i>(t)} constructed above. 

Next, we verify the condition (|3.5p . By the Cauchy-Schwarz and the Chebyshev 
inequalities 

(3.26) A(n) = ^E\\M(n)fl {llM(nW > n i^ } 

< ^(E\\M{n)t) 1/2 {P{\\M{n)r > n^}) 1/2 < -^E\\M{n)\\\ 

Now 

(3.27) ||M(n)|| < Eli |M,(n)| < E-=i (|V,(n)| + \W\ ~ \Ri(n 1)|) 

< ltlE„<»)<«<6(„) l y *,r(n)l + E ■=! " \Ri{n - 1)\) . 

Since (ai + • • • + a^) 4 < /c 3 (a 4 + • • • a 4 .) we conclude from here relying on 



Assumption 1 2 . 1 1 and the Holder inequality that for any n > 1, 
(3.28) £||Af(n)|| 2 < C 5 n iT 

where Cg > is independent of n, and so 

Since 6 < 1 we can choose 7 > so small that S — 2(1 — 7) < —1 whence 
E^°=i -<4(rc) < 00 and the condition (|3 . 5() holds true completing the proof of Propo- 
sition 13.31 □ 

Finally, (|2~T2|) follows from ([3~8]) in view of (|2~T0|) concluding the proof of The- 

□ 



4. Almost sure central limit theorem 
We start the proof of Theorem 12.41 with the following 
4.1. Proposition. Set 

£ 

(4.1) QW = s-^Qius) = s-y^Gjiujs), u e [0,1] 

and define random measures on C[0, 1] by 

^ ^) = ^/%., (u) ,*>l 

where 5 n (a) f . is i/ie itmi mass concentrated on the element Q, (w) € C[0,ll. Set 
also 

1 - 

(4.3) i/ n (w) = V fc- 1 ^,,) , n > 2. 

inn ■* — ' v « 

fc=l 

TTien wra£/i probability one 

(4.4) lim Ct = f]Q and lim 2/„ = 77Q 

t— foo 71— foo 

where, again, the limit is taken in the sense of weak convergence of measures on 
C[0,ll. 
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Proof. In the same way as in [3] we show first that with probability one the measures 
{Ct, t > e} are tight observing that the estimates for the Brownian motion in [3] go 
through for our process Q, as well, since it is a linear combination of linearly time 
changed Brownian motions. 

Next, as in [3] we define cj> : C[0, 1] ->• R by 

(4_5) = Eji(.°tix(uih ^a k x(u k )) 

for some k G N, < u\ < ■ ■ ■ < u k < 1 and ot\, a k G R. We want to show that 

(4.6) lim / <f>(x)( t (u>){dx) = / <f>(x)dr) Q {x). 
t_>oo 7c[0,l] Jc[o,i] 

Set 

(4.7) $ s = exp (i(a lA /uIi?„ lS H h a ky /uk~R UkS )) 

where i? s = Q^. Then 



1 /■* ds 



(4.8) / 0(x)C t (^)(^) = — / — $ 



hit 



•s 



/C[0,1] 

since y/uR us — y/uQi = Qu^ ■ Next, observe that the laws of {R s , s > 0} 
and {R s h, s > 0} (as processes) coincide for each h > since both processes are 
Gaussian with zero mean and in view of Theorem 12.21 the covariance function 

i i 

(4.9) ER sh R th = h~ l EQ^Qf = bT 1 ^ EGi(his)Gj(hjs) = s £ D l3 (iAj) 

i,J=l i,i=l 

does not depend on /i. It follows from here and the definition (|4.7|) that if we 
set i> s = <&i ns then the laws of {!>.,, s G R} and {$ s +/ l7 s G R}, del coincide. 
Then by the Birkhoff crgodic theorem together with the fact that the tail er-algebra 
nt>ocr{G ! i(u), G^u), Gi(u); u > t} is trivial (as for an ^-dimensional Brownian 
motion) we conclude that with probability one 

(4.10) lim IWOO \ Jl = lim^oo ± /" § e ^du 

= linin^oo i /" $ u du = E4> = E®!. 

A simple comparison of integrals and as in [3 shows also that 

t 

1 f d 

(4.11) lim - / — $ s = 

t->oo t J 1 S 

But by (@3]) and (|4T7|) . 

(4.12) = £exp(z( ai Q« + . . . + a k Q$)) = f <f>(x)dr) Q (x) 

JC[0,1] 

since Q ( u ] = Q{u). Hence, (gU) follows from ([3~7|) . P~5|) , (gHH and (|4~T2l . Since 
(|4.6|) holds true for any defined by (|4. 5[) then relying on tightness of the family 
{Ct, t > e} we obtain the first limit in (|4.4[) . The second limit there holds true by 
the same arguments as in [3] which are just estimates for the Brownian motion valid 
in our case of a linear combination of linearly time changed Brownian motions, as 
well. □ 
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In order to derive Theorem 12. 41 from Proposition [33] we will rely on the following 
result which appears in [3] as Lemma 2.12. 

4.2. Lemma. Let II, T : M+ -> C[0, 1] or II, T : N+ -> C[0, 1] fee measurable 
C[0,l]-valued stochastic processes such that, respectively, 

(4.13) lim ||ILj - T 8 ||c[o.i] = or lim ||n„ - T„|| C [o,i] = 

s— too n— >oo 

where \\ ■ ||c[o,i] * s ^ e supremum norm on C[0, 1]. XTien /or bounded, uniformly 

continuous functions f : C[0, 1] — > R, 

(4-14) 

& (ml / 7 <^ - /(Ts)) ) = ° ° r ^ £ fc " (/(n&) - /(Tfe)) ) = °" 

J 1 fc=i 

respectively. 

In order to prove Theorem 12.41 it suffices in view of Proposition 14. 1 1 and Lemma 
14.21 to show that 

(4.15) lim ||Q (n) -Qn||c[0,i] =0 a.s. 

where and Q n are defined by (|4.1j) and (|2.15j) . respectively. For each t € 

[0,1], n e N define #( n )(t) = (^ n) , ^ n) ) and G^(t) = (G[ n) , ...,G ( e n) ) where 
for j = 1, 

(4.16) tf^t) = n" 1/2 *j(jH)(l + [nt] - n<) + n- 1/2 %(j[nt] + j)(nt - [nt]), 

(4.17) G$ n) (t) = n- 1 / 2 G J (jH)(l + [ni] - nt) + n-^ 2 Gj(j[nt] + j)(nt - [nt]) 

and (t) = s~ 1 / 2 Gj (tjs) where tyj and Gj are the same as in (|2.11|) and Theorem 
12.21 respectively. Then in order to obtain (|4.15[) it suffices to show that for each 
j = l,...,£, 

(4.18) lim ||lfj n) -Gf ) || c[0)1] =0 a.s. and 

(4.19) lim ||G?j n) -*} n) ||c[o,i]=0 a - s - 

Now, in the same way as in [5] for each e > by the Doob martingale inequality, 

(4-20) P{\\H^-Gf\\ C[0tl] >^} 

<nEVo P {^Pk<t<k + i \Gj{jt) - Gj{jk)\ > < Ce- e n-\ 

This together with the Borel-Cantelli lemma yields (14.191) . Finally, 

(4.21) - *y>\\c[ ,i] < u-V 2 max \G,{jk) - ^(jk)\ 

J J l<fc<n+l 

and the right hand side of (|4.21[) converges with probability one to as n — > oo in 
view of Theorem I2.2[ completing the proof of Theorem 12.41 □ 

4.3. Remark. A slightly different method of proof of the almost sure central limit 
theorem from |11] can also be adapted to our nonconventional setup. 
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